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ABSTRACT 

The lack of systematic oversight of physician performance has led to some serious cases related to physician compe- 
tence and behaviour. We are currently implementing a hospital-wide approach to improve physician oversight by in- 
corporating it into the hospital credentialing process. Our proposed credentialing method involves four systems: (1) a 
system for monitoring and reporting clinical performance; (2) a system for evaluating physician behaviour; (3) a com- 
plaints management system; and (4) an administrative system for maintaining documentation. In our method, physi- 
cians are responsible for implementing an annual performance assessment program. The hospital will be responsible 
for the complaints management system and the system for collecting and reporting relevant health outcomes. Physi- 
cians and the hospital will share responsibility for monitoring professional behaviour. Medical leadership, effective 
governance, appropriate supporting information systems and adequate human resources are required for the pro- 
gram to be successful. Our program is proactive and will allow our hospital to enhance safety through a quality as- 
surance framework and by complementing existing safety activities. Our program could be extended to non-hospital 
physicians through regional health or provider networks. Central licensing authorities could help to coordinate these 
programs on a province- or state-wide basis to ensure uniformity of standards and to avoid duplication of efforts. 
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ON 12 NOV. 2005 NURSE LORI DuPONT WAS STABBED 
to death in Windsor, Ontario, by Dr. Marc Daniel 
as she left the hospital where they both worked. 1 ' 2 
Dr. Daniel subsequently took his own life. A coroner's in- 
quest identified many unheeded warning signs: Dr. Dan- 
iel had been the subject of numerous complaints to the 
hospital regarding serious inappropriate behaviour and 
he was known to have a severe mental disorder, putting 
him at risk of harming himself and others. 1 ' 2 

While this case is particularly stark, there are several 
other high-profile examples of physicians who continued 
to practise medicine despite a long history of inappropri- 
ate behaviour or a reasonable suspicion of incapacity or 
incompetence. 3 ' 4 We believe that these cases exemplify 
an opportunity for the medical profession to improve its 
willingness and capacity to oversee its performance. 



We describe a novel approach for physician oversight 
currently being implemented at The Ottawa Hospital. In 
our model, medical staff are responsible for leading the 
process and for supporting the activities necessary to 
make it a success. Physicians are delegated the critical 
task of determining whether performance-based criteria 
are met and whether maintenance-of-competence activ- 
ities are appropriate. Our model is fair and transparent 
and provides many benefits to the public, physicians and 
hospital administrators. It is built on quality improve- 
ment principles and acknowledges that most physicians 
perform at a high standard and that only a small minor- 
ity cause problems. Physicians in the latter group, how- 
ever, give rise to considerable litigation costs and pose 
an unacceptable risk to their patients and co-workers. 
Furthermore, managing this group diverts attention 
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from the real goal of the organization, which is to improve 
the quality of care offered by all providers. 

We have focused our implementation efforts on a hos- 
pital setting in view of the opportunities for innovation 
not available in community settings. Specifically, we can 
use resources dedicated to the annual credentialing pro- 
gram within the hospital. In addition, there is a critical 
mass of physicians, other health care providers and ad- 
ministrators who have a stake in ensuring high levels of 
physician performance. However, we believe our model 
could be generalized to the broader health care system. 

We designed our model with several principles in 
mind. First, we wanted to support the vast majority of 
physicians who are functioning at a high level. Thus, we 
have made the program formative rather than punitive. 
Second, we wanted to ensure a high level of physician 
accountability. Thus, physicians will be responsible for 
clinical performance assessments and for setting related 
targets, rewards and remedial actions. Third, we wished 
there to be real consequences for physicians who do not 
comply with the program. Thus, we have established ex- 
plicit, defensible processes. 

The problem 

Data from several sources highlight the wide extent of 
patient safety problems in health care. For instance, it 
is estimated that preventable adverse events lead to be- 
tween 9250 and 23 750 deaths in Canada annually. 5 In 
addition, significant numbers of patients experience in- 
creased pain or decreased functional ability as a result of 
preventable adverse events. 

It would be wrong to attribute these preventable ad- 
verse events solely to inadequate physician oversight. In 
most instances, these events are the result of systemic 
problems, including communication and technology 
infrastructures that are inadequate to support care pro- 
cesses, inadequate training, and insufficient resources. 5 
Even injuries resulting from provider error are usually 
the result of predisposing system factors (also termed 
latent factors) that make error all but inevitable. 7 ' 8 

A perceived lack of effective oversight process reinfor- 
ces the impression that physicians are part of the prob- 
lem. At times, there are valid concerns about professional 
behaviour and communication problems, 9 ' 10 which can 
be brought to the attention of hospital administrators or 
regulatory bodies. However, the management of these 
complaints can be adversarial, protracted and poorly 
coordinated. 11 This can leave complainants with the im- 
pression that the organization and the profession are self- 
protectively concealing facts. In addition, the absence of 
a transparent process for sanctioning physicians makes 



it difficult for the profession and for administrators to re- 
spond to complaints in a fair, consistent and defensible 
manner. 

At other times, there maybe concerns that a particular 
physician is practising outside his or her scope of prac- 
tice, that his or her outcomes are worse than those of 
peers or that he or she may not be keeping current with 
evolving professional standards. There are often few data 
to validate or disprove such concerns. 12 Even when there 
are data, they are usually not collected systematically in a 
scientifically sound manner. 13 

Another problem is the reactive nature of the current 
oversight system. As there are relatively few formal meth- 
ods for practice review, and because proactive, construct- 
ive feedback is not routinely available, physicians are left 
to decide for themselves when they need to adopt chan- 
ges in their practice and may realize this need only when 
there is a complaint. 

Current approaches to practitioner oversight 

Once physicians leave their training environment, there 
are few structured programs to monitor their capacity 
and performance. In Canada and the United States, prov- 
incial and state bodies grant licences to appropriately 
trained physicians. The same groups typically review 
licence eligibility annually, on the basis of information 
submitted by the physician about his or her scope of prac- 
tice and involvement in any litigation. 

Incremental changes in some jurisdictions have been 
designed to improve the system. For example, there are 
peer review programs directed toward randomly select- 
ed or high-risk physicians in some jurisdictions. There 
are also initiatives in several Canadian provinces to en- 
hance participation in continuing medical education and 
link it to the annual licence review process. 14-16 Finally, 
one jurisdiction in Canada requires a "360 0 " review on 
a regular basis, in which colleagues, other health profes- 
sionals—including subordinates— and patients answer 
standardized questions pertaining to a physician's char- 
acter and behaviour. 

Although these efforts are moving the system in the 
right direction, we believe they do not go far enough. 
Credit for participating in continuing medical education 
activities typically recognizes the act of taking part in the 
education program, not the content studied or the actual 
uptake of learning into practice. Furthermore, communi- 
cation between the education program providers and the 
provincial regulators is not always ensured. 

More importantly, the majority of practitioners func- 
tion in private settings where there are few opportunities 
for meaningful peer assessments and timely, constructive 
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feedback. Ideally, communities of practice could support 
ongoing learning, especially in the context of maladapt- 
ive behaviour. 

An opportunity to regulate physicians more closely 
exists within hospitals, where there is a legislated re- 
quirement for physicians to obtain privileges annually. 
Physicians working in an institution could provide rou- 
tine peer assessments coupled with meaningful feed- 
back. There might also be opportunities to identify and 
react to maladaptive behaviour. Physicians wishing to ob- 
tain the privilege of practising within an institution must 
typically supply documents demonstrating that they have 
met certain training standards, have a current licence, 
have up-to-date malpractice insurance and have not been 
involved in any lawsuits or complaints to the licensing 
body. Unfortunately, the current system of credentialing 
physicians within hospitals is largely administrative, de- 
spite efforts to enhance the system through the develop- 
ment of accreditation standards. 

In Australia, the Quality Expert Advisory Group is 
completing the development of a position statement on 
scope of practice and credentialing. 17 For now, the pro- 
grams for credentialing and physician oversight in Aus- 
tralia are similar to those in Canada. 18 In the United 
Kingdom, the Postgraduate Medical Education and Train- 
ing Board appears to be favouring a revalidation system 
that will use evidence of participation in audit, outcome 
data, prescribing data and complaints and feedback from 
patients and colleagues. 

Most of the programs described above do not require 
continuing medical education, and we are not aware of 
any programs that collect clinical performance data pro- 
actively. By combining some existing strategies with other 
components such as complaints and physician behaviour, 
we believe we can significantly improve the effectiveness 
of credentialing programs. 

A proposal to improve hospital credentialing 
programs 

Our program consists of four components: a system to 
monitor clinical performance, a system to monitor pro- 
fessional behaviour, a complaints management system 
and a system to manage administrative requirements 
(Table 1). All four systems will be managed by the medic- 
al leadership. Active engagement by physicians and their 
leaders is essential, as seen in Figure 1. 

Monitoring clinical performance. The first component 
of our program involves assessing whether physicians 
are providing the best possible care. As clinical per- 
formance is the purview of physicians, assessment must 



be delegated to the physician leadership. Our program 
specifies two broad areas in which it is to be assessed: 
scope of practice and performance. 

Scope of practice refers to the tasks and procedures a 
physician is capable of performing safely and effectively. 
We consider scope of practice to include procedures, such 
as surgeries, and cognitive tasks, such as patient assess- 
ments and prescribing. Physicians must be able to prove 
that they have had training appropriate to qualify them to 
perform a particular procedure or task. 

The term performance refers to whether physicians are 
meeting a standard of care consistent with those of their 
peers. There are initiatives to establish core competen- 
cies of performance, including the Good Medical Practice 
initiative. 20 ' 21 These initiatives create a framework within 
which performance indicators relevant to different spe- 
cialties can be derived. For example, an interventional 
cardiologist might have performance metrics related to 
outcomes such as death rates after myocardial infarction, 
adherence to myocardial infarction treatment guidelines 
and post-angioplasty renal failure rates. A system with 
adequate statistical approaches for small sample sizes 
will be required to make calculated risk adjustments. 

Measurement is a major challenge in performance as- 
sessment. 22 In general, performance can be measured 
explicitly by assessing pre-specified outcomes within 
particular diagnostic groups or by assessing compliance 
with evidence-based treatment guidelines. This approach 
can be inexpensive and is relatively straightforward, as 
indicated above. Alternatively, performance can be meas- 
ured implicitly by peer review: the reviewer rates whether 
overall care quality met the standard of care. This meth- 
od is also easily performed but can be expensive, as it re- 
quires physicians to act as peer reviewers. Both methods 
of assessment are well supported by evidence, assuming 
that appropriate case-selection methodologies are used 
to identify charts for review and assessors use appropri- 
ate rigour while performing the chart review. Our model 
uses both the explicit and implicit approaches. 

In our program, clinical division chiefs are respon- 
sible for evaluating whether all providers meet standards 
of clinical performance. First, they must establish ex- 
plicit criteria by which scope of practice is defined and 
by which performance is monitored, and they must en- 
sure that all physicians are familiar with these criteria. 
Second, they must measure whether physicians meet the 
standards. It is critical that they ensure that measure- 
ments are applied to all physicians equally and that they 
take place in a standardized fashion on a known sched- 
ule. Finally, they must ensure the consistent application 
of appropriate corrective measures if providers are not 
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Central Credentialing 
Committee 

Chair: Chief of Staff 



Clinical Performance 
Assessment System 



Responsibility: 
Clinical division chief 



Professional Behaviour 
Assessment System 



Responsibility: 
Hospital administration 
and clinical division 
chief 



Complaints 
Management System 



Responsibility: 
Hospital patient 
relations department 
and clinical division chief 



Administrative 
Requirements 



Responsibility: 
Hospital administration 



Figure 1: Components and hierarchy of the credentialing program 



meeting their standards. We feel it is important for the 
hospital to delegate these responsibilities to clinicians. 
However, the hospital must provide the infrastructure 
for monitoring and reporting on physician performance. 

Monitoring professional behaviour. The second com- 
ponent of our program is a system to monitor profes- 
sionalism. Professionalism encompasses a wide range 
of behaviours and thus is challenging to measure. For 
simplicity, we have focused on two domains of behav- 
iour: maintenance of competence and interpersonal 
relationships. 

Well-established lifelong learning programs exist to 
monitor participation in maintenance-of-competence ac- 
tivities. These have been instituted at a national level in 
many countries. 23 We feel that local activities should be 
harmonized with national standards to increase adher- 
ence and, more importantly, to create real consequences 
for physicians— namely, the loss of hospital privileges— if 
they do not comply. 

We recommend that the responsibility for monitor- 
ing maintenance-of-competence activities be left at the 
divisional level as long as the activities are part of an ac- 
credited program. 24 This ensures that learning activities 
appropriate for the particular physician group will be se- 
lected, and peer pressure will help to create and sustain 
interest in the learning activities. 

We also feel that interpersonal relationships can be 
assessed relatively simply. We recommend using a 360 0 
approach in which several patients, and fellow providers, 
are asked to provide input using a standardized and valid- 
ated question set. This methodology is currently used 
in the licensing process in Alberta 25 and Nova Scotia; it 



was also recommended by the coroner's jury in the Du- 
pont inquest. 1 Part of the question set would evaluate a 
physician's adherence to the standards of conduct. This is 
particularly important because many interpersonal prob- 
lems and complaints arise from a physician's failure to 
show respect or to consider the patient's interests first. 10 
The assessment of interpersonal relationships should 
be the joint responsibility of the hospital leadership and 
the clinical division heads; this responsibility includes 
selecting assessors, ensuring that the assessments are 
completed and the results collated, and establishing ap- 
propriate corrective measures if problems are identified. 
Assessors should be peers and should seek input from 
colleagues, non-physician health care providers and 
patients. 

Complaints management system. The third component 
of our program is a system for managing complaints. Al- 
though this component is the most reactive and least con- 
structive aspect of our program, we feel it is important 
for maintaining accountability. It also has the potential to 
capture aspects of physician performance and behaviour 
that are missed with other components of the program. 
Furthermore, the systematic use of patient complaints is 
an excellent engine to drive improvements in quality of 
care. 26 

We have modelled our complaints management system 
on one built at Vanderbilt University. 27 This system stan- 
dardizes the processes for complaint intake, complaint 
triage (to distinguish between important and frivolous 
complaints), investigation, and communication. 

At our hospital, managing the complaints management 
system is predominantly the responsibility of the patient 
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relations department. We feel it is important, for two rea- 
sons, that the physician leadership not be responsible for 
managing complaints. First, there is an inherent conflict 
of interest in investigating one's peers, which might limit 
or cast doubt on objectivity. Second, there is a need to 
create a standard process across the entire organization. 
The role of the physician leadership in this system is to 
reach agreement on corrective action with the physician 
involved in the complaint and to monitor improvements. 
Optimal functioning of a hospital's complaints manage- 
ment system therefore requires a joint effort by the phys- 
ician leadership and the patient relations staff. 

System for managing administrative requirements. 

The final component of our program is a system for man- 
aging administrative tasks. It includes two main tasks: 
the administration of the overall credentialing program, 
and the administrative collection of documents required 
to prove that practitioners are qualified. These tasks are 
managed entirely with hospital resources. 

The administration of the credentialing program in- 
volves several high-level requirements. First, it requires 
a mechanism for tracking the compliance of each individ- 
ual physician with all aspects of the program. This will al- 
low individual physicians to see how they are performing 
in relation to their peers and accepted standards and will 
allow hospital leaders to more effectively gauge the per- 
formance of physicians. Second, it requires an appropri- 
ate communication and education program to support 
physicians as they learn about their performance and 
how it is being measured. Third, it involves maintenance 
and oversight of the complaints management system, as 
a centralized complaints process is more likely to be fair 
and transparent. 

At our hospital, the second aspect of our administra- 
tive management system consists of the remnants of our 
pre-existing credentialing program. Essentially, this is 
the process by which documents validating a physician's 
credentials are collected. As we have discussed, this pro- 
cess is clearly not sufficient for ensuring that physicians 
are maintaining their qualifications, but it is certainly 
necessary. 

What are the barriers to implementing this 
credentialing system? 

The comprehensive credentialing system we have de- 
scribed will require significant financial resources and 
a trusting and constructive relationship between phys- 
icians and hospital management. It is critical that the 
governance of the system be clearly described so that 
stakeholders will trust the program and participate fully. 



The roles and responsibilities of each member of the ad- 
ministrative staff and medical leadership in the creden- 
tialing program must be articulated. The assessment 
methods and complaints management processes must be 
communicated, so that all who are affected fully under- 
stand the processes and recognize their responsibilities. 
Finally, all involved must make an unwavering commit- 
ment to work collaboratively and to follow the program 
processes to improve care quality. 

A supporting information systems infrastructure is 
another critical element. Existing information systems 
can be used to collect data on clinical performance. For 
example, we are collecting information on various health 
processes and outcomes of care by analyzing relevant 
data from a hospital data warehouse. 28 Other groups 
have adopted a similar approach. Information systems 
can also support the complaints management system and 
manage administrative tasks. Unfortunately, a compre- 
hensive system incorporating solutions for all these re- 
quirements is not available commercially and would have 
to be designed locally. 

Administrative staff will be required to manage the 
credentialing program, and clinical divisions will require 
access to human resources data to monitor clinical per- 
formance. The cost of these resources needs to be shared 
equitably between the hospital and physician staff. 

The credentialing program must be coordinated with 
the existing processes of the provincial or state organiza- 
tions responsible for licensure. There is a concern that 
physicians will not understand the relationship between 
these processes or that there could be duplication of ef- 
fort. It is also possible that conflicting recommendations 
could arise. We feel that these risks can be managed and 
that they are outweighed by the benefits arising from lo- 
cal administration of the credentialing program. 

A final absolute requirement for our credentialing pro- 
gram is clinical leadership and engagement. Clinicians 
need to be responsible for the credentialing process, as 
only clinicians can judge the technical proficiency of 
other physicians. 

Expected benefits and limitations 

Our approach has five main benefits. First, the system 
will identify physicians who are having difficulties much 
earlier than the current system. Although continuous 
monitoring may identify problems even faster, we believe 
an annual performance assessment balances effective- 
ness with practicality. Second, our program provides a 
greater capacity for the institution and its physicians to 
learn about quality problems and thereby improve hos- 
pital care. Because physicians will be accountable for 
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performance, there will also be a greater incentive for 
them to participate in the development of systems solu- 
tions to improve care delivery. Third, it will be easier for 
hospital administrators and clinical leaders to take action 
against physicians who repeatedly perform poorly and 
do not respond to feedback. Fourth, our system might 
provide protection against litigation by sanctioned phys- 
icians because it is more explicit, objective, consistent, 
fair and transparent than the current system. Finally, 
and perhaps most importantly, public trust in our health 
care institutions will improve. 

Our proposal has at least three limitations. First, not 
all physicians are affiliated with hospitals large enough to 
implement such a program. Ambulatory care physicians 
and physicians working in smaller hospitals require as 
much oversight as those in large hospitals— and perhaps 
more, given they are often quite isolated from their peers. 
However, we argue that it may be possible to adapt the 
processes developed in large hospitals to other settings, 
such as regional health authorities or health networks of 
providers or hospitals. 

A second limitation of our approach is that it does not 
specifically address physician health. Other industries or 
professions regularly evaluate physical and mental health 
as part of assessments of worker fitness. 29 We believe 
such regular evaluations should be incorporated into cre- 
dentialing systems once they are established. Although 
the program at our hospital does not directly evaluate 
physician health, we believe that it will nevertheless iden- 
tify cases in which significant health issues are affecting 
a physician's performance. For instance, a formal review 
of a physician performing poorly might reveal that he or 
she is suffering from mental illness. A comprehensive 
program is needed to respond in a supportive fashion to 
instances of physician incapacity or incompetence. 

A third potential limitation of our approach is the 
paucity of valid measures for clinical performance and 
professional behaviour. Physicians should design the 
indicators and monitor data collection. They should agree 
to be measured by the methods that will be used. This 
will increase the likelihood that they will accept the re- 
sults of the evaluation and be willing to act on them. 

Conclusion 

The current credentialing system for physicians is highly 
administrative and is mostly reactive in its interventions. 
We believe this results in a lack of systematic oversight of 
physician performance, which is a serious quality gap in 
our health care system. 

The program we have proposed for oversight of 
physician credentialing is systematic, comprehensive, 



proactive, transparent, objective and practical. In the 
long term, it is designed to help physicians across the per- 
formance spectrum: the goal is not to oust problematic 
physicians, but to help them address their weaknesses. 
We acknowledge that this system will require significant 
financial and human resources, changes in governance 
and increased collaboration between hospital leaders 
and physician leaders. We also recognize that our model 
has certain limitations. Nevertheless, we believe a pro- 
cess such as the one we propose is necessary to bridge the 
quality gap that currently exists and to help fulfill phys- 
icians' fiduciary obligation to ensure the highest standard 
of professional conduct and care by all practitioners. 
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